Multiscale Manifold Learning
نویسندگان
چکیده
Many high-dimensional data sets that lie on a lowdimensional manifold exhibit nontrivial regularities at multiple scales. Most work in manifold learning ignores this multiscale structure. In this paper, we propose approaches to explore the deep structure of manifolds. The proposed approaches are based on the diffusion wavelets framework, data driven, and able to directly process directional neighborhood relationships without ad-hoc symmetrization. The proposed multiscale algorithms are evaluated using both synthetic and real-world data sets, and shown to outperform previous manifold learning methods.
منابع مشابه
Multiscale Analysis of Data Sets with Diffusion Wavelets
Analysis of functions of manifolds and graphs is essential in many tasks, such as learning, classification, clustering. The construction of efficient decompositions of functions has till now been quite problematic, and restricted to few choices, such as the eigenfunctions of the Laplacian on a manifold or graph, which has found interesting applications. In this paper we propose a novel paradigm...
متن کاملDiffusion polynomial frames on metric measure spaces
We construct a multiscale tight frame based on an arbitrary orthonormal basis for the L2 space of an arbitrary sigma finite measure space. The approximation properties of the resulting multiscale are studied in the context of Besov approximation spaces, which are characterized both in terms of suitable K–functionals and the frame transforms. The only major condition required is the uniform boun...
متن کاملDiffusion-driven Multiscale Analysis on Manifolds and Graphs: top-down and bottom-up constructions
Classically, analysis on manifolds and graphs has been based on the study of the eigenfunctions of the Laplacian and its generalizations. These objects from differential geometry and analysis on manifolds have proven useful in applications to partial differential equations, and their discrete counterparts have been applied to optimization problems, learning, clustering, routing and many other a...
متن کاملMultiscale Dictionary Learning: Non-Asymptotic Bounds and Robustness
High-dimensional datasets are well-approximated by low-dimensional structures. Over the past decade, this empirical observation motivated the investigation of detection, measurement, and modeling techniques to exploit these low-dimensional intrinsic structures, yielding numerous implications for high-dimensional statistics, machine learning, and signal processing. Manifold learning (where the l...
متن کاملMultiscale Estimation of Intrinsic Dimensionality of Data Sets
We present a novel approach for estimating the intrinsic dimensionality of certain point clouds: we assume that the points are sampled from a manifold M of dimension k, with k << D, and corrupted by D-dimensional noise. When M is linear, one may analyze this situation by SVD: with no noise one would obtain a rank k matrix, and noise may be treated as a perturbation of the covariance matrix. Whe...
متن کامل